A Generalization of Chaitin's Halting 
Probability Q and Halting Self-Similar Sets 

Kohtaro Tadaki* 

Department of Mathematics, Graduate School of Science, 
Hokkaido University, Sapporo 060-0810, Japan 
E-mail: tadaki@math.sci.hokudai.ac.jp 



Abstract 

We generalize the concept of randomness in an infinite binary sequence in order 
to characterize the degree of randomness by a real number D > 0. Chaitin's halting 
probability Q is generalized to Q D whose degree of randomness is precisely D. On 
the basis of this generalization, we consider the degree of randomness of each point in 
Euclidean space through its base- two expansion. It is then shown that the maximum 
value of such a degree of randomness provides the Hausdorff dimension of a self- 
similar set that is computable in a certain sense. The class of such self-similar sets 
includes familiar fractal sets such as the Cantor set, von Koch curve, and Sierpihski 
gasket. Knowledge of the property of Q D allows us to show that the self-similar 
subset of [0, 1] defined by the halting set of a universal algorithm has a Hausdorff 
dimension of one. 
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1 Introduction 



The Kolmogorov complexity H(s) of a finite binary sequence s is the size, in bits, of the 
shortest program for a universal algorithm U to calculate s. The concept of Kolmogorov 
complexity plays an important role in characterizing the randomness of an infinite binary 
sequence. In |]C3[1 , the four concepts of randomness in an infinite binary sequence (Chaitin, 
weak Chaitin, Martin-L6f, and Solovay randomness) are considered. These four concepts 
are shown to be equivalent to one another. In this paper, we first generalize these four 
concepts of randomness in order to deal with the degree of randomness of an infinite binary 
sequence. The degree of randomness is specified by a real number D with < D < 1. As D 
becomes larger, the degree of randomness increases. In the case when D — 1, the concept 
of the degree of randomness becomes the same as that of randomness. The relationship 
among the generalized concepts of randomness is investigated. Chaitin's halting probability 
Q is an example of a random real number. We generalize Q to Q D so that the degree of 
randomness of Q D is precisely D. Although the first n bits of Q can solve the halting 
problem for a program of size not greater than n, the first n bits of Q D can solve the 
halting problem for a program of size not greater than Dn. Moreover, Q D is infinitely 
differentiate as a function of D, and each derivative d k Q D /dD k has the same properties 
as tt D . 

On the basis of this generalization, we next study the relationship between the degree 
of randomness and Hausdorff dimension. Hausdorff dimension is closely related to Kol- 
mogorov complexity, as studied by several researchers e.g., | |K1|| , | |R2| |, |fStl|| , JCTjfl , and [ |St2| . 
In these previous studies however, the normalized Kolmogorov complexity lim^oo H(x n )/n 
of a real number x was considered, where x n is the first n bits of the base-two expansion of 
x, and Hausdorff dimension was related to the normalized Kolmogorov complexity. That is 



to say, in [|R1[| , [|R2|1 , |Stlj| , and [|St2|1 , the Hausdorff dimension of a subset F of R was com- 
pared with the maximum value, or supremum, over the normalized Kolmogorov complexity 
linv^oo H(x n )/n for all points x in F. (We recommend reading |[3tl|| as a monograph.) On 
the other hand, [ |CH| | considered the Hausdorff dimension of the graph of the normalized 
Kolmogorov complexity lim^oo H(x n )/n as a function of x. 

If an inifinite binary sequence is random, then its normalized Kolmogorov complexity 
is equal to one; however, the converse is not necessarily true. Thus, although the concept 
of normalized Kolmogorov complexity is related to randomness it alone cannot capture 
randomness. Corresponding to this fact, the concept of the degree of randomness which 
we introduce in this paper is more insightful than that of the normalized Kolmogorov com- 
plexity. Consideration of the degree of randomness allows us to classify infinite sequences 
which have the same normalized Kolmogorov complexity. Hence, we study the relationship 
between Kolmogorov complexity and Hausdorff dimension using a more rigorous system 
than previous work. 

We introduce six "algorithmic dimensions", 1st, 2nd, 3rd, 4th, upper, and lower al- 
gorithmic dimensions as fractal dimensions for a subset F of Mr. These dimensions are 
defined by means of Kolmogorov complexity. On the one hand, the 3rd, 4th, upper, and 
lower algorithmic dimensions are related to the maximum value, or supremum, over the 
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normalized Kolmogorov complexity for all points in F and were, in essence, researched by 
R2| and |[5tl|| . On the other hand, the 1st and 2nd algorithmic dimensions are related to 



the maximum value over the degree of randomness for all points in F. Therefore, they 
are stronger concepts with regard to the possibilities of their existence than the former 
four algorithmic dimensions. We show that all six algorithmic dimensions are equal to the 
Hausdorff dimension for any self-similar set that is computable in a certain sense. The 
class of such self-similar sets includes familiar fractal sets such as the Cantor set, von Koch 
curve, and Sierpihski gasket. 

Based on the relationship between the definition of Q D and the mathematical theory 
of self-similar sets (e.g., |[Hu|| , [ |Ha|| ), we define the self-similar subset Fh a it of [0, 1] by using 



the halting set of a universal algorithm U. We may regard -Fhait as the set of an endless 
succession of coded messages sent through a noiseless binary communication channel. From 
the property of Q D , it is shown that Fhait has a Hausdorff dimension of one and a zero- 
Lebesgue measure. 

The paper is organized as follows. In the next section, we review some basic concepts 
from algorithmic information theory. We then treat the definition of Hausdorff dimension. 
Section 3 is devoted to a generalization of the concepts of randomness in an infinite binary 
sequence through the introduction of a real number D. Chaitin's halting probability Q 
is also generalized. In section 4, the six algorithmic dimensions for a subset of M. N are 
defined by means of Kolmogorov complexity, and their properties are investigated. The 
halting self-similar set Fhait is introduced in section 5. The Hausdorff dimension and all 
six algorithmic dimensions of F ha i t are evaluated. 



2 Preliminary definitions 

In this section, we first recall some basic notations from algorithmic information theory 
or the theory of Kolmogorov complexity. According to |(J 1| | , we use some variant of Kol- 



mogorov complexity, i.e., Kolmogorov complexity based on self-delimiting programs; we 
recommend reading |(J1|. 



#5 is the cardinality of S for any set S. N = {0,1,2,3,...} is the set of natural 
numbers, and N + is the set of positive integers. Z is the set of integers, and Q is the set of 
rational numbers. R denotes N- dimensional Euclidean space, where M 1 = R is just the 
set of real numbers. X = {A, 0, 1, 00, 01, 10, 11, 000, 001, 010, . . . } is the set of finite binary 
sequences, and X is ordered as indicated. For any s G X, \s\ is the length of s. X°° is 
the set of infinite binary sequences. For any a G X°°, a n is the prefix of a of length n, 
especially, a is the empty word A. For any S C X, 3(S) denotes the set of infinite binary 
sequences beginning with a finite sequence that belongs to S, i.e., 

3(S) = { a G X°° | 3n G N a n G S } . (1) 

We write "r.e." instead of "recursively enumerable." 

A subset S of X is called a prefix-free set if no sequence in S is a prefix of another 
sequence in S. For any partial recursive function C : X — >• X, the domain of C is denoted 
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by domC, i.e., domC = { p E X | C(p) is defined }. A computer is a partial recursive 
function C : X — > X such that domC is a prefix-free set. Let C be a computer. For any 
s G X, Hc(s) is defined as 

ifc(s) = min { \p\ \ p E X & C(p) = s } (may be oo). (2) 

It is shown that there exists a computer U such that for each computer C there exists a 
constant sim(C) with the following property: if p E domC, then there is a q for which 
U(q) = C(p) and \q\ < \p\ + sim(C). We choose any one of such a computer U and 
define H(s) = Hu(s), which is referred to as the algorithmic information content of s, 
the program-size complexity of s, or the Kolmogorov complexity of s. Thus H(s) has the 
following property: 

VC : computer H(s) < H c (s) + sim(C). (3) 

We see that there is c E N such that for any s ^ A, 

//(s) < |s| +21og 2 \s\ +c. (4) 

For any n E N, is defined to be //(the nth element of X). 

Chaitin's halting probability Q is defined as 

pedom U 

It is then shown that < Q < 1. 

Normally, o(n) denotes any one function /: N — > R such that lim^oo f(n)/n = 0. 

Let .D be a real number. D mod 1 denotes D — \_D\ , where [-DJ is the greatest integer 
less than or equal to D, and D mod '1 denotes D — \D] + 1, where \D~\ is the smallest 
integer greater than or equal to D. Hence, D mod 1 E [0, 1) but D mod '1 G (0, 1]. We say 
that D is computable if the base-two expansion of D can be generated by an algorithm, 
i.e., if there exists a total recursive function /: N + — > {0, 1} such that 

0./(l)/(2)/(3)/(4) 

is the base-two expansion of D mod 1. The following three conditions are equivalent to 
one another. 

(a) D is a computable real number. 

(b) If /: N + — > Z with f(n) = [Dn\ then / is a total recursive function. 

(c) There exists a total recursive function /: N + — > Z such that \D — f(n)/n\ < 1/n for 
all n E N+. 
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Let x G M. N and use the coordinate form ). For each i = 1, . . . , N 

we denote x l mod 1 in base-two notation with infinitely many zeros: 



x l mod 1 = 0.x\x l 2 xl (6) 



We then define code N : R N -> X°° as 



N ■ 

COcIgjy^^C^ — OC-^X-^ . . . OC^du^ • • • *^3*^3 * * * (^0 

Throughout the rest of the paper, where there is no likelihood of confusion, code^r^) may 
be denoted simply by x. Thus x n is the first n bits of the infinite binary sequence code at (x) 
for any x G R . We will identify any point of R with an infinite binary sequence in this 
manner. 

Definition 2.1 (Hausdorff dimension). If U is any non-empty subset of R , the diam- 
eter of U is defined as \U\ = sup { |x — y| I x, y G U }. Suppose that F C R^ and D > 0. 
If {Ui} is a countable (or finite) collection of sets of diameter at most 5 that cover F, i.e., 
F G [J i Ui with < |Z7j| < 8 for each %, we say that {Ui} is a <5-cover of F . For any 5 > 
we define 

Hf(F) = inf | \ U i\° i U i} is a <5-cover of F 1. (8) 

i ^ 

We then define 

*H D (F) = \imHf(F). (9) 

o— >U 

This limit exists for any subset F of M N , though the limiting value can be or oo. It is 
shown that 7i D is an outer measure on R . 7i D is called D-dimensional Hausdorff outer 
measure. Finally, the Hausdorff dimension dim# F of F is defined as 

dim H F = inf { D > | H D (F) = } . (10) 



See e.g., the book [F2] for a treatment of the mathematics of Hausdorff dimension and 
self-similar sets. 



3 D- Randomness 

This section is, for all intents and purposes, a generalization of Chapter 7 in |C3 



Definition 3.1 (weakly Chaitin .D-random). Let D be a real number and D > 0, and 
let a G X°°. a is called weakly Chaitin .D-random if 

3c Gi Vn G N Dn-c<H(a n ). (11) 
If T is a subset of NxX and z G N, we write = { s | (z, s) G T }. 
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Definition 3.2 (Martin-L6f D-test). Let T C N x X and D > 0. T is called Martin-L6f 
.D-test if T is an r.e. set and 

Mien 2 ~ D|s| ^ 2 ~ l - ( 12 ) 

Definition 3.3 (Martin-L6f D-random). Let D > and a G We say a is Martin- 
Lof .D-random if 

VT : Martin-L6f D-test 3z G N a £ U(T). (13) 

In the case where D — 1, the weak Chaitin D-randomness and Martin-Lof D-randomness 
result in weak Chaitin randomness and Martin-Lof randomness respectively, which are de- 



fined in C3 



Remark 3.1. Suppose that D is a computable real number and D > 0. Then there exists 
a universal Martin-Lof .D-test i.e., 

3 U D : Martin-Lof D-test VT : Martin-Lof D-test 
f| 3(71) C f| J(ZYf). 

i e N i 6 N 

Thus, a is not Martin-Lof D-random if and only if a G HieN^C^P)- 

Theorem 3.1. Let D be a computable real number and D > 0. For any a G a is 

weakly Chaitin D-random •<=>■ a is Martin-Lof D-random. 



The proof of Theorem |3.1| is given in Appendix |A.l 



Definition 3.4 (D-compressible). Let a G X°° and D > 0. We say that a is in- 
compressible if 

H(a n ) < Dn + o(n), (14) 

which is equivalent to 

— #K) < D (15) 

We generalize Chaitin's halting probability Q as follows. 
Definition 3.5 (Generalized halting probability). 

n D = J2 (D>0). (16) 

pGdom U 

Thus, n = O 1 . If < D < 1, then fi D converges and < Vt D < 1, since fi D < Vt < 1. 
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Theorem 3.2. Let D be a real number. 



(a) If < D < 1 and D is computable, then Q D is weakly Chaitin D-random and D- 
compressible. 

(b) Ifl<D, then Q D diverges to infinity. 

Proof, (a) Suppose that < D < 1 and D is a computable real number. 

We first show that Q D is weakly Chaitin Z)-random. The proof is a straightforward 
generalization of Chaitin's original proof that Q is weakly Chaitin random. Let p\,p2,P3, ■ ■ ■ 
be a recursive enumeration of the r.e. set dom U. Let a be the infinite binary sequence 
such that O.a is the base-two expansion of Q D with infinitely many ones. Then, since D is 
a computable real number, there exists a partial recursive function £ : X — > N + with the 
property that 

0.a n < ]T 2-¥ (17) 

i=l 

It is then easy to see that Dn < \pi\ for all i > C,(a n ) (i.e., given a n , one can calculate all 
programs p of size not greater than \_Dn\ such that U(p) is defined). Hence, Dn < H(s) 
for an arbitrary s G X such that s ^ U{pi) for all z < £(a n ). Therefore, given a n , by 
calculating the set { U(pi) | i < £(« n ) } and picking any finite binary sequence that is not 
in this set, one can obtain an s G X such that Dn < H(s). 

Thus, there exists a partial recursive function ^ : X — > X with the property that 

Dn < H(V(a n )). (18) 

Using (||), there is a natural number such that 

tfOK)) < #«) + c*. (19) 

Therefore, a is weakly Chaitin D-random. It follows that a has infinitely many zeros, which 
implies that a = codei(f2 D ). Thus, fl D (i.e., codei(fi D )) is weakly Chaitin D-random. 

Next, we prove that fl D is D-compressible. We note that there exists a total recursive 
function /:N + xN->N such that 



k I I 



i=l 



< 2~ n . (20) 



Let P be the infinite binary sequence such that 0./3 is the base-two expansion of the halting 
probability Q. 

Given n and f3\Dn\ (he., the first \Dn\ bits of 0), one can find a ko with the property 
that 

ko 

0.f3 lDn] <£VK (21) 
i=i 
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It is then easy to see that 

oo 

2~ M < 2~ Dn . (22) 

i=k +l 

Using the inequality for real numbers a c + b c < (a + b) c (a, b > 0, c > 1), it follows that 



< 2~ n . (23) 



From ©, (H), and \Q D - 0.a n | < 2~ n it is shown that 

| O.a n -2~ n f(k ,n) | <3-2" n . (24) 

Hence 

oc n = /(fco, n), /(fc , n) ± 1, /(fc , n) ± 2, (25) 

where a n is regarded as a dyadic integer. Based on this, one is left with five possibilities 
of a n , so that one needs only 3 bits more in order to determine a n . 

Thus, there exists a partial recursive function $ : N + x X x X — >• X such that 

VnG N + 3seX \s\ = 3 & $(n,/3 rDn1 ,s) = a n . (26) 

From @ it follows that 

H(a n ) < \f3 lDn] | + o{n) < Dn + o(n), (27) 

which implies that fi 13 is D-compressible. 

(b) Suppose that D > 1. We then choose a computable real number <i satisfying 
D > d > 1. Let us first assume that Q d converges. Based on an argument similar to the 
first half of the proof of Theorem |3.2| (a), it is easy to show that Q d is weakly Chaitin 
ci-random, i.e., there exists c G K such that dn — c < H((Q d ) n ). It follows from (|]) that 
dn — c < n + o(n). Dividing by n and letting n^oowe have d < 1, which contradicts the 
fact d > 1. Thus, Q d diverges to infinity. By noting fi d < f2 D it is shown that Q D diverges 
to infinity. □ 



Suppose that < D < 1 and D is a computable real number. From Theorem [T2] (a) 
it follows that lim^oo H((Q D ) n )/n = D. Also, (fi D ) n solves the halting problem for a 
program of size not greater than Dn, as is shown in the proof of Theorem |3]2| (a). 

Moreover, as shown in the following theorem, Q D is infinitely differentiable as a function 
of D G (0, 1), and each derived function d k Q D /dD k has the same properties as Q D . 

Theorem 3.3. Let /: (0, 1) — > R with f(D) = Q D . For any p G domU, let f p : (0, 1) — > R 
with f p (D) = 2-\pV°. 



S 



(a) f is a function of class C°° , and for each k G N + , 

VDG(0,1) f k \D)= f ( 28 ) 

p£dom U 

where and fp k ^ are the k-th derived functions of f and f p respectively. 

(b) Let k G N + and D be a computable real number in (0,1). Then f^ k \D) is weakly 
Chaitin D-random and D -compressible. 

Proof. It is shown that for each k G N + , 

where Qk{z) is the polynomial of degree k with integer coefficients such that Quiz) = 
z k - k(k - l)z k - 1 + ■■■ + (-l) fc - 1 ib!z. 

(a) We note that for each k there exists L such that if \p\ > L then for any D G (0, 1), 
fp k \D) > 0. We wish to show by induction on k that the fc-th derived function f^ of / 
exists and fl28|) holds. The result is obvious for k = from the definition of Q D . Suppose 
that the hypothesis is true for k = i. We see that there is L such that if \p\ > L then 
fp\D), f{, i+1) (D), ff +2 \D) > for any D G (0, 1). Let D G (0, 1). We then choose D 
so that D < D < 1. Using the mean value theorem, it is shown that if \p\ > L then 

{ ) D -D D -D- m 

Hence 

£ fp +1) (D) < E /«(A>). (31) 

|p|>i ° |p|>£ 

By the inductive hypothesis, ^2 p fp (D ) is convergent. Thus ^2 p fp (D) is convergent 
for any D G (0, 1). Since fp +1 ^ is a monotone increasing function for any p with |p| > L, 
it is easy to see that ^2 p fp (D) is uniformly convergent on (0,1) in the wider sense. 

Therefore, Ylpfp (D) is termwise different iable, which implies that the hypothesis is true 
for k = i + 1 as desired. 

(b) Let k G N + . We then note that there exists L G N such that if \p\ > L then 

V D6 (0,1) i<^g t (W£?) (32) 



and 

1 f|p|ln2 xni ' 



(33) 
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is a monotone increasing function of D E (0, 1). Let Pi,P2,P3, ■ ■ ■ be a recursive enumera- 
tion of the r.e. set | p E dom£/ & \p\ > L}. Also, let Sl = { p \ p E domU & \p\ < L\, 
which is a finite set. The proof is similar to the case of fl D . 

Suppose that D is a computable real number in (0, 1). We then note that X} p es L fi> k \D) 
is also a computable real number. 

We begin by showing that f( k \D) is weakly Chaitin D-random. Let a be the infinite 
binary sequence such that O.a is the base-two expansion of f^ k \D) mod '1 with infinitely 
many ones. 

Given a n , one can find a G E N with the property that 

pes L i=i 

It is then easy to see that 

oo 

£ /W(D)< 2 -\ (35) 

i=G+l 

Hence, from Q3"2|), Dn < for all i > G. One can then calculate the set 

{ tf(p) | p E S L } U { Z7(pi) | ^ < G } (36) 

and therefore pick an s E X that is not in this set. It follows that Dn < H(s). 
Thus, there exists a partial recursive function \I/ : X — > X such that 

Dn < H(V(a n )). (37) 

Based on an argument similar to the case of Q D , we see that a is weakly Chaitin D- 
random. Since f^ k \D) mod 1 = f^ k \D) mod '1 = O.a, it follows that f^ k \D) is weakly 
Chaitin D-random. 

Next, we prove that f^ k \D) is D-compressible. We note that there exists a total 
recursive function g : N + xN^Z such that 



E ^ " L/ (fc) P)J + E ^0°) - 2- n sKn) 
pe^t i=i 



< 2~™. (3* 



Let g? be any computable real number with D < d < 1, and let (3 be the infinite binary 
sequence such that 0./3 is the base-two expansion of f^ k \d) mod 1. We then note that 
^2 p( zs L fp k \d) is a computable real number. 

Given n and (3\Dn/d\ (i- e - ; the first [Dn/d] bits of /?), one can find an M E N with the 
property that 

M 

u^ k \d)\ + o./w, < e fi k) ( d ) + E WW- ( 39 ) 

pe5 L i=l 
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It is then easy to see that 



E f£ ) ( d )<2~ 



Dn/d 



(40) 



i=M+l 



Raising both sides of this inequality to the power d/D and noting the way of choosing L, 



i— flyf-Ll L \ /J 



i=M+l 

oo 



(41) 



> E 4f ] P). 



i=M+l 



It follows that 

From @D, (H), and 
it is shown that 



M 



E4 fe) P)+E4f ) ^)-/ (A) (^) 



4=1 



< 2" 



L/^p)J+0.«„.-/ w ( J D)|<2 



(*)/ 



a n — g(M, n) \ < 2, 



where a n is regarded as a dyadic integer. 

Thus, there exists a partial recursive function $ : N + x X x X — > X such that 

VnGN + 3sGl |s| = 3 & $(n,/3r J j n / < f],s) = a„. 



(42) 

(43) 
(44) 

(45) 



Using an argument similar to the case of we see that a is D/<i-compressible. Since d is 
any computable real number with D < d < 1, it follows that f^ k \D) is D-compressible. □ 



Remark 3.2. Suppose that is an infinite r.e. subset of X. Chaitin proved that both 



j2 

u( P )ew 



and 



£ 2 ~ 

saw 



H(s) 



(46) 



(47) 



are weakly Chaitin 1-random as Q. Corresponding to this fact, it is shown that both 

J2 2~ bl/D (48) 
u(p)eW 



and 



(49) 
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have the same properties as Q D , i.e., the following results hold: (i) If D > 1 then both 
(fi8|) and fl49|) diverge to infinity, (ii) As a function of D, each of fl48|) and (|49|) is infinitely 
termwise differentiable on (0, 1). (iii) If k G N and D is a computable real number in (0, 1) 
then, for each of ( f48[ ) and (fEJ), the value of its k-th derived function at D is weakly Chaitin 
D-random and D-compressible. 

Definition 3.6 (Chaitin D-random). Let D be a real number and D > 0, and let 

a G X°°. a is called Chaitin D-random if 

lim H(a n ) - Dn = oo. (50) 

n— >oo 



Definition 3.7 (Solovay D-test). Let T cNx! and D >0. T is called Solovay D-test 
if T is an r.e. set and 

£ 2"^ < oo, (51) 

(V)ST 

where the sum is over all i and s such that (i, s) G T. 

Definition 3.8 (Solovay D-random). Let D > and a G X°°. We say that a is Solovay 
D-random if 

VT : Solovay D-test 3m GN Vi > m a(£3(%). (52) 



In the case where D = 1, the Chaitin D-randomness and Solovay D-randomness result 
in Chaitin randomness and Solovay randomness respectively, which are defined in [C3] . 



Theorem 3.4. Let D be a computable real number and D > 0, and let a G X°° . Then a 
is Chaitin D -random <^=^ a is Solovay D -random. 



The proof of Theorem |3]^ is immediately obtained by generalizing the proof of Theorem 
R3iniC3|. 



Theorem 3.5. Let D > and a G X°°. a is Chaitin D -random a is weakly Chaitin 
D-random. 

Proof. This is immediately apparent from the definitions. □ 



Remark 3.3. The converse of Theorem 3.5 holds for D — 1, because all Martin-Lof 1- 



random sequences are Solovay 1-random, as is shown in ||U3|| . However, whether the con- 
verse of Theorem |3.5| also holds for any computable real number D with D < 1 is an open 
problem. 

Definition 3.9 (semi D-random). Let D > and a G X°°. We say a is semi D-random 
if 

D < lim (53) 



n 
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Proposition 3.6. a is weakly Chaitin D-random ==>- a is semi D-random. 

Proof. This is obvious from the definitions. □ 



In general, the converse of Proposition 3.6 does not necessarily hold. For example 



although the infinite binary sequence r^ra considered in the proof of Theorem |5.1| 

is semi 1-random, it is not weakly Chaitin 1-random. 

Proposition 3.7. The following four conditions are equivalent to one another. 

(a) a is semi D-random. 

(b) Dn + o{n) < H{a n ). 

(c) V d e R ( < d < D a is Chaitin d-random ) . 

(d) VfielR ( < d < D a is weakly Chaitin d-random ). 

Proof. The above equivalences follow immediately from the definitions. □ 

4 Algorithmic Dimensions 

We introduce the six fractal dimensions which are related to the degree of randomness or 
the normalized Kolmogorov complexity. 



Definition 4.1 (algorithmic dimensions). Let F be a subset of 



(a) The 1st algorithmic dimension of F, which is denoted by dim^i F, is defined as D G R 
such that 

V x E F x is —-compressible (54) 

and 

3 a; G F x is Chaitin —-random. (55) 

(b) The 2nd algorithmic dimension of F, which is denoted by dim^ F, is defined as 
D e R such that 

Vx G F x is —-compressible (56) 

and 

3 a; G F a; is weakly Chaitin —-random. (57) 

(c) The 3rd algorithmic dimension of F, which is denoted by dim^ 3 F, is defined as 
D eR such that 

Va; G F x is —-compressible (58) 

and 

3 x G F x is semi —-random. (59) 
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(d) The 4th algorithmic dimension of F, which is denoted by dim^F, is defined as 
Del such that 

Vx G F x is —-compressible (60) 



N 



and 



D 



V < — 3x (z F x is Chaitin <i-random. 

N 



(e) The lower and upper algorithmic dimensions of F are respectively defined as 



D 



dim 4 F = sup <j D > 

H(x n ) 
sup hm — -— - 

xeFn->oo n/N 



3 x e F x is Chaitin — random 

N 



and 



dim aF = min < D > 



D 

Vx G F x is —-compressible 



sup hm — —— 

l6 fn^oo n/N 



(61) 

(62) 
(63) 

(64) 
(65) 



Although the upper and lower algorithmic dimensions always exist unless F is the empty 
set, the existences of the 1st, 2nd, 3rd, and 4th algorithmic dimensions of F are nontrivial. 
However, the uniqueness of each algorithmic dimension of F is trivial for any non-empty 
set F. Note that the condition ( |61| ) in the definition of the 4th algorithmic dimension is 
equivalent to D < sup xeF ]hn n ^ 00 H(x n )/(n/N). Also, from Proposition |3~7|, the condition 
"Chaitin <i-random" in ( |61| ) can be equivalently replaced by "weakly Chaitin <i-random" or 
"semi (i-random" . Thus, we need not consider the alternative definitions which are obtained 
by such replacements in the definition of the 4th algorithmic dimension. The 'dimension' 
iV of Euclidean space M. N appears in the definition of each algorithmic dimension. If we 
identify any point in M. N with an infinite sequence over an alphabet that consists of 2^ 
elements instead of an infinite binary sequence, and redefine Kolmogorov complexity using 
a computer whose range is the set of finite sequences over such an alphabet, then iV vanishes 
from these definitions. 

The properties of the 3rd, 4th, upper, and lower algorithmic dimensions were, in essence, 
studied by |EUJ and |[Stl|| . As more restrictive concepts, we introduce the 1st and 2nd algo- 
rithmic dimensions which are related to the degree of randomness instead of the normalized 
Kolmogorov complexity. 

Proposition 4.1. The algorithmic dimensions satisfy the following properties, 
(a) For each k = 1, 2, 3, 4 ; if dim^ F exists then < dim^ F < N . 
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(b) IfdiuiAiF exists then dim^2 F also exists and is equal to dim^i F. Similarly, for 
k = 2,3, if dim^fc F exists then dim^+i) F also exists and is equal to dim^ fc F. 

(c) There is E C WL N such that dim^F exists and dim^F does not exist. Also, there 
is F C K such that diuu3 F exists and diuu2 F does not exist. 

( d) For each k — 1,2, 3, 4, if E C F and &ot/i dim^ F and dim^fc F exzsi i/ien dim^u F < 
d\m Ak F. 

(e) For each k = 1,2,3,4, if both dim^F and dim^F exist then dim^/ c (F U F) also 
exists and is equal to maxldim^ E, dim^ F}. 

(f) If divo-AiFi exists for all i G N + then dim^lj^ F) also exists and is equal to 

SU Pl<i<oo dim A4F. 

(g) If F is an open subset ofM. N then dim^F = N for k = 1,2,3,4. 

(h) If < D < 1 and D is computable then dim^jfi 15 } = D for k = 2, 3, 4. 

(i) < dim 4 F < dim^F < N. 

(j) For each k = 1,2, 3, 4, if dim^ F exists then dim 4 F = dim^F = dim^ F. 

(k) If dim 4 F = dim^F then dim^F exists and these three algorithmic dimensions are 
equal to one another. 

Proof. These properties are obvious consequences of the definitions. The proof of Propo- 
sition (c) is given as follows. Let < D < 1 and 

F = { Vt d | < d < D and d is computable } . (66) 

Then dim^4 E = D but dim^ E does not exist. Also, F ha i t (introduced in the next section) 
is an example of a set F such that dim^ F exists but dim^ F does not. See Theorem [5j] . 
Proposition |4.1| (g) follows from the fact that for any s G X there is a Chaitin 1-random 
infinite binary sequence whose prefix is s. □ 

Corresponding to Remark |3.3| , it is an open problem whether or not there is a set F 
such that dimyi2 F exists and dim^ F does not. 

If dim^ F exists, which follows from the existence of either dim^i F or dim j42 F, then 
dim^3 F = max^gp lim^oo H(x n ) / (n/N), where the maximum is over all x G F such that 
lim^oo H(x n )/(n/N) exists. Note that from the definition of code^y, x n corresponds to 
the first n/N digits of the base- two expansions of all components of x G M. N . This implies 
that dim^ 3 F is the maximum value over the program-size complexity per digit in base-two 
notation for all points in F. 

Let A be a non-empty closed subset of M. N . A transformation S: A — > A is called a 
contraction on A if there is a number c with < c < 1 such that \S(x) — S(y)\ < c \x — y\ 
for all x, y in A. Let (p denote the class of all non-empty compact subsets of A. It is shown 
that the following theorem holds for contractions Si, ... , S m on A (for its proof, see e.g., 
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Theorem 4.2. Let Si, . . . , S m be contractions on A. Then there exists a unique non-empty 
compact set F which satisfies 

m 

F = [jS l (F). (67) 

i=l 

Moreover, if we define a transformation S: (p — > (p by 



S(E) = \JS l (E) (6* 



and write S k for the k-th iterate of S given by S°(E) = E, S k (E) = S(S k ~\E)) for k > I, 
then 



F = p| S\E) (69) 



fc=i 



for any set E in ip such that Si(E) C E for each i. 



The unique non-empty compact set F satisfying (J67 ) is called the invariant set of the 
contractions Si, ... , S m . 

A contraction S on A is called a similarity on A if there is a number c with < c < 1 
such that \S(x) — S(y) \ — c \x — y\ for all x, y in A (c is called the ratio of S). The invariant 
set of a collection of similarities is called a self-similar set. 

Let Si, ... , S m be similarities on A. We say that Si, ... , S m satisfy the open set condi- 
tion if there exists a non-empty bounded open set V C A such that 

in 

VD(jSi(V) (70) 

i=i 

andS t (V)nS J (V)=<j ) (i^j). 

Theorem 4.3. Let Si, . . . , S m be similarities on R wii/i ratios C\, . . . , c m respectively. We 
then note that each Si is an affine transformation, i.e., for each i there exist N x N matrix 
Mi and V{ G M such that Si{x) = MiX + Vi. We assume that all matrix elements of Mi and 
all components of Vi are computable real numbers for each i. Furthermore, suppose that 
the open set condition (fT0|) holds for Si, ... , S m . If F is the invariant set of Si, ... , S m , 
then dim^i F exists and dim^i F = dim# F = D, where D is given by 



£cf = l. (71) 



i=l 



Therefore, all six algorithmic dimensions of F exist and are equal to dim// F . 

The proof of Theorem PO is given in Appendix |A.2|, and here we only present some 



examples of familiar self-similar sets F which are shown to satisfy dim^n F = dim# F as a 



consequence of Theorem [O 
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Example 4.1. 

(a) The middle-third Cantor set is the invariant set F of the similarities Si, S2 on R with 
ratios 1/3, 1/3 such that 

Si(x) = ±x, S 2 (x)= l -x+ 2 -. (72) 

The open set condition ( |70|) holds for Si, S2 with V as the open interval (0, 1). All of 
the real constants which appear in affine transformations ([72]) (i.e., 0, 1/3, and 2/3) 



are computable real numbers. Thus, by Theorem [4.3|, dim^i F = dim^F = log 3 2, 
which is the solution of (1/3) D + (1/3) D = 1. 

(b) The Sierpihski gasket with vertices at the points (0, 0), (1, 0), and (1/2, v3/2) is the 
invariant set F of the similarities Si, S2, S3 on M. 2 with ratios 1/2, 1/2, 1/2 such that 



0C \ 2 



Si 



5 3 



:) - 8 D C) + (i 



The open set condition (|T0D holds for Si, 52, 5*3, taking V as the interior of the 
equilateral triangle with vertices at (0,0), (1,0), and (l/2,\/3/2). All of the real 
constants which appear in affine transformations ([73) (i.e., 0, 1/2, 1/4, and v3/4) 
are computable real numbers. It follows from Theorem |4.3| that dim^i F = dim^ F = 
log 2 3, which is the solution of (1/2) D + (1/2) D + (1/2^ = l - 

(c) A modified von Koch curve F C M 2 is constructed as follows. Fix a computable real 
number r with < r < 1/3. Initially, consider a line segment which has endpoints 
(xi,yi) and (£2,2/2) such that all of x\,yi,X2,yi are computable real numbers. Con- 
struct a curve F by repeatedly replacing the middle proportion r of each line segment 
by the other two sides of an equilateral triangle. (In the case where r = 1/3, F results 
in the von Koch curve.) Then we can select the four similarities Si, S2, 53, S4 with 
ratios Ml—r), r, r, |(1— r) which have the following properties: (i) The curve F is the 
invariant set of Si, ... , S4. (ii) The open set condition holds for Si, ... , S4. (hi) All 
of the real constants which appear in each affine transformation Sj are computable 
real numbers. Thus, from Theorem [4.3| we see that dim^i F = dini^ F = D, where 
D satisfies 2r D + 2(±(1 - r)) D = 1. 

5 Halting self-similar sets 

The halting self-similar set Fh a it is defined as 

Fbait = { 0.<?i<? 2 <?3 • • • I ft e dom C7 for each % } . (74) 
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Fh a it is a compact subset of [0, 1]. Let S p (x) = 2 l p 'x + O.p for each p G domfJ. Then Fhait 
satisfies 

U S p (F halt ). (75) 

p£dom C/ 

Thus, since dom {7 is a countably infinite set, Fhait is a self-similar set in the sense that 
-Fhait is a union of a countably infinite number of smaller similar copies of itself. Also, since 
domU is a prefix-free set, the function family {S p } satisfies an open set condition in the 
sense that there exists a non-empty bounded open set V (i.e., the open interval (0, 1)) such 
that V D Up S P (V) and S P (V) fl S q (V) = 4> {p ^ q)- Using the fact that dovaU is an r.e. 
set and not a recursive set, it is easy to show that { s G X | J(s) fl F ha i t 7^ } is also an 
r.e. set and not a recursive set, where I(s) = [O.s, O.s + 2~' s l). 



Remark 5.1. As considered in ||C1|| , think of U as decoding equipment at the receiving 
end of a noiseless binary communication channel. Regard its programs (i.e., finite binary 
sequences in dom U) as code words and regard the result of the computation by U as the 
decoded message. Since dovnU is a prefix-free set, such code words form what is called 
an "instantaneous code," so that successive messages sent through the channel can be 
separated. Then Fhait is the set of x G [0, 1] such that the base- two expansion of x is an 
endless succession of coded messages sent through the channel. 

Theorem 5.1. dim# Fhait — 1 one? C l (Fh a i t ) = 0, where C 1 is Lebesgue measure on M.. 
Neither dim A1 F haU nor dinu 2 F hatt exists, but dim A3 F haU = dim AA F halt = 1 . 

Proof. To begin with, we show that dim^F ha i t = 1. Let Pi,P2,P3, ■ ■ ■ be a recursive 
enumeration of the r.e. set dom U, and let 

P m = { 0.gi<? 2 <?3 • • • I qi € {Pi,P2, • • -,Pm} for each i } . (76) 



Then P m is the invariant set of S P1 , S P2 , . . . , S Pm . Since the open set condition (|70j) holds 
for S Pl , S P2 , . . . , S Pm , from Theorem |A.10| in Appendix |A.2| it is shown that dimn P m = F> rn , 



where D m is given by 

m 

^ 2 " Dm|Kl = l. (77) 

Now, from the definition of Q D , 



n£ = £V c K (75 



i=l 



From Theorem |3]^ (b), this sum diverges to infinity for each D G (0, 1). Hence, given 
e > 0, for all sufficiently large m 

m 

J22- (1 ~ £)M > 1 (79) 

i=l 
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and 



^V 1 -^ 1 < n 1 < 1, 



(80) 



i=i 



which implies that 1 — e < D m < 1. Thus, linim^oo D m = 1. Since P m C F halt , it follows 
that dim H F halt = 1. 

Second, we prove that £ 1 (Fh a it) = 0. We see that for each n G N + , 

£\F halt ) <£' ({0. gi ...q n a | gi ,...,q n edomU kaeX™}) 

~ 1^ 1 (81) 

<ji,...,cjn£dom [/ 
= (ft 1 )™. 

Since < Q 1 < 1, letting n — > oo gives £ 1 (Fh a it) = 0. 

Third, we prove that dim^ Fh a it = dim^4 Fhait = 1. Fix a weakly Chaitin 1-random 
sequence j3 such as the base-two expansion of Q. For each k G N + , let be any one of 
the shortest q such that U(q) is equal to the k bits sequence from (k — l)k/2 + 1th bit to 
kik + l)/2th bit of (3. Also, let y = 0.rir 2 r 3 It follows that y G F halt . 



Given y n , one can find ri, r 2 , r 3 , 



, t such that y„ 



^i^2^3 • • • and t is a proper 



prefix of r m+ i, possibly £ = A. One can then calculate /3 m ( m +i)/2 from ri,r 2 ,r 3 , . . . ,r m . 
Hence, there exists a partial recursive function X — > X such that for each n G N + , 
^(Vn) — Pm(m+i)/2 where m is the greatest integer with the property that \r 1 r 2 r 3 . . . r m \ < 
n. Using (Rf), it is easy to show that there is d G N such that 



m(m + 1) 



d < H{y n ). 



52) 



However, using (|4]), \rk\ < k + 2 log 2 k + c for any G N + . Thus 



n < |rir 2 r 3 . . .r m r m+1 
(m + l)(m + 2) 



< 



+ log 2 (m + 1)! + c(m + 1) 



(83) 



Since letting n 



oo implies m — > oo, it follows that 

m(m + 1) 



1 < lim 



2n 



34) 



Combining with (|8~2] ) this implies that ?/ is semi 1-random. 

Now, it follows from @ that x is 1-compressible for all Thus, dim^ 3 Fhait = 1, 

which shows, from Proposition [O] (b), that dim^Fhait = 1- 

Finally, we show that neither dim A1 F halt nor dim A2 F halt exists. If dim^ 2 Fhait exists 
then, by Proposition |TT] (b), dim^ 2 F halt = dim^ 3 -F halt = 1> which implies that there 
is x G -Fhait such that x is Martin-L6f 1-random. However, we will show that x is not 
Martin-L6f 1-random for any x G -Fhait- 
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Choosing a G Q with Q 1 < a < 1 it follows that 



2-\ qi - q "\ < a n . (85) 

iji,...,g„6dom[/ 

Let / : N — > N be a total recursive function such that a^ 1 ' < 2 - ' for all «€N. The r.e. set 

T = { (hQiQ2 ■ ■ ■ ?/(*)) | i e N & g 1? q 2 , ■ ■ -,qf(i) e domC/ } (86) 

is then Martin-L6f 1-test. For any x G -Fhait, Vi G N x G 3(7*) and hence a; is not 
Martin-L6f 1-random. 

Thus, diniA2-Fhait does not exist. From Proposition [O] (b), dirndl Fhait also does not 
exist. □ 

We say that / : X — > X is an optimal code if for each s6l, f(s) is one of the shortest 
program for U to calculate s, i.e., U(f(s)) = s and \f(s) \ = H(s). For any optimal code / 
and W C X, F opt (f, W) is defined as 

F opt (f, W) = { 0.f(s l )f(s 2 )f(s 3 ) \siEW for each 2 } . (87) 



The following theorem, which is similar to Theorem 5.1, then holds. 



Theorem 5.2. Suppose that f is an optimal code and W is an infinite r.e. subset of X. 
Then 

dinus F opt (f, W) = dim A4 F opt (f, W) = dim H F opt (f, W) = 1 
and C l {F opt {f, W)) — 0. However, neither dim ai F opt (f,W) nor dim^ 2 F opt (f, W) exists. 
Proof. The sum 

2~ H{S)/D (88) 

sew 

diverges to infinity for any D > 1, as we mentioned in Remark |3.2j . Thus, using an 
argument similar to the case of F halt , we see that dim H F opt (f, W) = 1. 

Note that F opt {f,W) C F halt . Thus, C\F opt {f ,W)) < C l {F^ Xt ) = 0. 

Next, we prove dim^3 F opt (f, W) = 1. Fix a weakly Chaitin 1-random sequence f3. 
For each G N + , let be any one of the shortest q such that U(q) is equal to the k 
bits sequence from (k — l)k/2 + 1th bit to kik + l)/2th bit of f3. Since W is an infinite 
r.e. set, there exists a one-to-one total recursive function £ : X — > VF. Let y = 0./(£(ri)) 

f{£( r 2)) f(£,( r 3)) It is then shown that y G F opt (f, W) and there is G N such that 

for any k G N + , | /(£(?**.) )| < k + 21og 2 k + eg. Moreover, one can calculate {3 m (m+i)/2 from 
/(C( r i))) /(£( r 2)), f{C( r s))i ■ ■ • 5 /(£( r m))- Thus, making an argument similar to the case 
of Fhait it is shown that y is semi 1-random. Hence, dim^3 F opt (f, W) = 1, and therefore 
dim A4 F opt (/,W0 = l. 

As was shown in the proof of Theorem |5.1|, there is no Martin-L6f 1-random sequence 



in Fhajf Since F opt (f, W) C -F halt , there is no Martin-L6f 1-random sequence in F opt (f, W). 
Thus, neither dim^i F opt (f, W) nor dim^2 F opt (f, W) exists. □ 
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For each W C X , we define 

F halt (W) = { 0. qi q 2 q 3 | Ufa) E W for each i } , (89) 

which is a generalization of -F ha i t , i.e., F halt = F halt (X). Note that 

^o P t(/, W) C F halt (H/) C F halt (90) 

for any optimal code / and any infinite r.e. set W C X. The following generalization of 
Theorem 15.11 holds. 



Theorem 5.3. Suppose that W is an infinite r.e. subset of X. Then 

dmi4 3 F hatt (W) = dmi44 F haU (W) = dim H F ha i t (W) = 1 
and ^(Fhai^W)) = 0. However, neither dim A i F halt (W) nor dim^2 F ha i t (W) exists. 
Proof. This follows immediately from Theorem p.l| , Theorem |572|, and ((9^) . □ 

Remark 5.2. ||R1|| showed that for any r.e. set L G X, 



dim 4 L°° = dimf, L°° (91) 

where L°° = { Oii/2/3 • • • | G L for each i } (see also | |Stl| ]). Suppose that / is an optimal 
code and W is an infinite r.e. subset of X. Since { q E X | U(q) e W } is an r.e. set, 
using (|9~ID and dim.^43 F^^W) = 1 we immediately see that dim H F halt (W) = 1. On the 
other hand, since { f(s) | s E W } is not an r.e. set, it would seem difficult to prove 
dim^F opt (/, W) = 1 directly from ( pTj) and dim^ F opt (f, W) = 1. In Theorem |5~2| , using 
the property of the sum ((49]), we proved dim^F opt (/, W) = 1. 

A Appendix 

A.l The proof of Theorem |S7T| 

In the case where D = 1, Theorem ^]l| results in Theorem Rl in ||C3|| . The proof of 



Theorem |3.1| is a straightforward generalization of the proof of Theorem Rl given in 



We need the following two theorems shown in ||C1|| . 



Theorem A.l. Let both f: N — > X and g: N — > N &e tote/ recursive functions. Suppose 
that 



^ 2 - 9(n) <l. (92) 



n=0 



Then there exists a computer C such that 



Hc( s ) — m i n g( n )- (93) 

f(n)=s 
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Theorem A. 2. There is c G N such that for any n6N and k G Z ; 

#{seX| |s| = n & ff(s) < fc } < 2 fc -^ (n)+c . (94) 



Theorem [A.l| and Theorem [A.2| are Theorem 3.2 and Theorem 4.2 (b) in ||C1|| , respec- 
tively. 



The proof of Theorem |3.1| is as follows 



Proof of Theorem Suppose that D is a computable real number and D > 0. Let 
/: N —>■ N with f(n) = [Dn\. Then / is a total recursive function, 
(-i (weak Chaitin) -i Martin- L of ) 

-i (weak Chaitin) says that for any fceN there is n G N such that H(a n ) < f(\a n \) — 
k. Let T = { (A;, s) G N x X | -ff(s) < /(|s|) — A; — c } for the natural number c which is 



referred to in Theorem |A.2j . Then a G J(7fc) for any fcGN. 



However, it follows from Theorem [A.2| that #{sG7fc||s|=n}< 2 Dn H ( n ' k for any 



k, n G N. Hence, for any fceNwe get 

oo 

£ 2" D I S I = ^ # { s G T fc | |s| = n } 2- D " 

(95) 

- 2 fe ( 2 H(n) ) - 2 < 2 fc - 

\n=0 / 

Since / is a total recursive function, T is an r.e. set. Thus, T is Martin-L6f D-test, and 
hence a is not Martin-L6f D-random. 
(-i Martin-Ldf => -i (weak Chaitin)) 

Suppose that there exists a Martin-L6f D-test T such that a G 3(7^) for any n G N. 
Then 



oo oo 



n=2 seT„ 2 n=2 s£% 



(96) 

< ^2~ n2+n+1 < 1. 



n=2 



Since T is an r.e. set, there exists a bijective total recursive function g from N to the 
set | (n, s) | n > 2 & s G 7^2 }. Let n(/c) and s(fc) be total recursive functions such that 
g(k) = (n(k), s(k)) for all keN. Then 



oo oo 



^ 2 - [/(|s(fc)l) - n(fe)1 = Yl 2~ [/(|s|) ~ n] < 1. (97) 



k=0 n=2 s&T n2 

Since / is a total recursive function, by Theorem |A.1| , there is a computer C such that 

H c (s)= min {f(\ s (k)\)-n(k)}. (9* 

s(fe)=s 
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Using ([3]), it follows that 

n>2&cseT n 2 H(s) < D\s\ -n + sim(C). (99) 

Thus, since a G 3(7^) for all n > 2, we see that for all n > 2 there exists /c G N such that 
H(a k ) < D \a k \ - n + sim(C) = Dk-n + sim(C), (100) 
which implies that a is not weakly Chaitin D-random. □ 



A. 2 The proof of Theorem RT3 



For each D > 0, we define Tp and T|, by 



7* = <| x G to7V 



x is not Chaitin —-random }> ( 101 ) 



x is not weakly Chaitin —-random }> . ( 102 ) 



Theorem A. 3. Let D > 0. If D is a computable real number, then Tp and T|, are Borel 
sets and 7i D {T l D ) = H D (T%) = 0. 

Proof. In the case that D = 0, the results are obvious from the fact that Tq = Tq = <p. 
Thus we assume that D > 0. 

We first show that 7i D (T^,) = 0. Suppose that T is Solovay D/N-test. For any s G X, 
we write ?7(s) = { x G [0, 1)^ | s is the prefix of x }. It follows that 2_^(j S )er |£/(s)| D < oo. 
Also, we let T(T) = { x G [0, 1)^ | Vm G N 3z > m x G 3(7^) }. Then, for any 5, e > 0, 
it is shown that there exists a <5-cover {U{s k )} k of r(T) such that £ fc < £ - Hence > 

(r(T)) < e. It follows that H D (T(T)) = 0. 

On the other hand, Theorem |3.4| implies that D [0, 1)^ = |J T(T), where the union 
is over all Solovay D/N-test T. Since there are only countably many Solovay D / N-tests, 
it follows that TiPiT^ n [0, l) N ) = 0. By noting the fact that Hausdorff outer measures 
are translation invariant (i.e., H D (F + z) — Ti, D (F), where F + z = {x + z\ x<E F} ), we 
see that H D (Tl) = 0. 

From Theorem 13.41 it follows that 



T d = U fl U ( x G RN I code N(x) G } , (103) 



T n=0 i=n 

where the leftmost union is over all Solovay D/N-test T. Thus, Tp is a Borel set. 



Similarly, using Theorem pA\ it is shown that H (T5) = and T5 is a Borel set. □ 



In the case where N — 1 and D — 1, 7i D (T^) = HPiT^) = states the well-known 
fact that the set of all non-random real numbers has a zero-Lebesgue measure. 
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For each D > 0, we define Tp by 



T. 



D 



x G 



. D 

x is not semi — random 
N 



Corollary A.4 (Staiger (Stlfl, Cai and Hartmanis flCHU ). If D > then T 
Borel set and H D (T%) = 0. 



(104) 



is a 



Proof. In the case that D = 0, the results are obvious from the fact that Tq = 0. Thus we 
assume that D > 0. Let £) 1; D 2 , ■ • • be a sequence of computable real numbers such that 
lim^oo D n = D and for any n, D n < D. Using the equivalency between (a) and (c) in 
Proposition |3.7|, we see that Tp = U^Li^i) • Hence, by Theorem [A.3| , Tp is a Borel set. 
Since 7i D is non-increasing with D, it follows that 7i D (Tp) = 0. □ 

Corollary A. 5 (Ryabko ||R1|| ) . dim H F < dim 4 F, and for each k = 1, 2, 3, 4, if dim Ak F 
exists then dim# F < diuufc F . 

Proof. Let D = dim# F. Since the results are trivial for D = 0, we assume that D > 0. 
For any e > 0, we choose a computable real number d such that D — e < d < D. From 
Theorem |iO| it follows that H d (F\T}) = H d (F) > 0. Hence, F\Tj ^ and therefore 
there is x G F such that x is Chaitin (i/iV-random. Thus, we see that D — e < dim 4 F for 
any e > 0, from which the results are easily produced. □ 

Definition A.l (r.e. condition). Suppose that F is a subset of R . We first define 

F mod 1 = { (a; 1 mod 1 , x 2 mod 1 , . . . , x N mod 1 

{x l ,x 2 , 



,x N )eF}. 



(105) 



For any s G X, we define I(s) = [O.s, O.s + 2~l s l) and I(s) = [O.s - 2"l s l,0.s + 2~l s l + 
2~l s l) mod 1. We also generalize I(s) and I(s) to intervals on M. N by the following manner. 



I(si,s 2 , 

I(S1,S2, 

Finally, we define 

art(F) = {( Sl , 



Sjy) = J(si) x I{s 2 ) x • • • x /(s^), 
Sjy) = J(si) x J(s 2 ) x • • • x /(s^). 



and 



^(F) = {( Sl , 



sn) 



\ s l\ = 

Hsu 



= \s N \ & 

,s N ) n (F mod 1) ^ } 

= |sjy| & 

sjv) n (F mod 1) ^ }. 



(106) 
(107) 



(106 



(109) 



We say that F satisfies the r.e. condition if there exists an r.e. set L such that 
m(F) CLC Tl(F). 
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The meaning of the r.e. condition is as follows. First we note that F mod 1 C [0, 1)^. 
For all n G N, divide [0, 1)^ into 2 Nn pieces of N dimensional subintervals in the form 
I(si, S2, ■ ■ ■ , sjv) with = |s 2 | = ••■ = |sjv| = n - Then, intuitively, the r.e. condi- 
tion is that all of the subintervals Ps intersecting F mod 1 and some of the subintervals 
neighboring to these J's form an r.e. set. 

Let F be a bounded subset of R , and let N$(F) be the smallest number of closed balls 
of radius 5 that cover F. The upper box-counting dimension of F is defined as 

hgNs(F) 



dim B F = lim to - \ ' . (110) 
8^0 -log 5 

Theorem A. 6 (Kolmogorov). If F is a bounded subset of M. N and satisfies the r.e. 
condition, then x is (dim^F) /N -compressible for any x G F, i.e., 



VxGF Vn G N H(x n ) <^^n + o{n). (Ill) 

Proof. The essential part of the proof is due to Kolmogorov. 

For each m G N, we consider the collection of cubes in the 2~ m -coordinate mesh of R , 
i.e., the collection of sets of the form 

[k2- m , (h + l)2- m ) x ■ ■ ■ x [l N 2~ m , (l N + l)2~ m ), (112) 

where li, . . . , Zjy are integers. Let M m (F) be the number of 2~ m -mesh cubes that intersect 
F. It is then shown that 

35E.F ^ EE (113 ) 

m-*oo m 

(see e.g., B)- 

Suppose that x = (x 1 , . . . ,x N ) is any point in F. Since the r.e. condition holds for 
F, there exists an r.e. set L such that 971(F) C L C 971(F). We consider the following 
procedure in order to calculate x n . 

Given n, one enumerates all elements (s\, . . . , sn) of L such that = \n/N~\. There 
then appears the element (t\, . . . , t^) in the enumeration with the property that 

(x 1 mod 1, . . . , / mod 1) G I{t u ...,t N ). (114) 

Assume this (ti, . . . , tjv) is the k n th element in the enumeration order. If one knows n and 
k n , then one can calculate the first \n/N~\ bits of the base- two expansion of each x % mod 1 
with infinitely many zeros and hence one can calculate x n further. 

Thus, since k n < 3 N M^ n /N] (F), we see that H(x n ) < log 2 Mp n /^r| (F) + o{n). Using 
( |113| ), the result is produced. □ 

Theorem [A.6| immediately gives the following corollary. 

Corollary A. 7. Suppose that F is a bounded subset ofM, N and satisfies the r.e. condition. 
Then dim^F < dim^F. Moreover, for each k = 1,2, 3, 4, ifdim^k F exists then dim^fe F < 
dim^F. 
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Theorem A. 8. Let F be a bounded subset ofM> N . Suppose that F satisfies the r.e. condi- 
tion and dim// F = dinieF. Let D = dim// F. 

(a) dim^F exists and dim^F = dim//F. 

(b) IfTC D (F) > 0, then dim^ F exists and dim^F = dim//F. 

(c) If7i D {F) > and dim// F is a computable real number, then both dim^i F and 
dircu2 F exist and dim^i F = dim^ F = dim// F. 



Proof. It follows from Theorem [A.6| that x is (dim// F)/iV-compressible for any x G F. 



Using Corollary [A. 5 , we see that dim^F = dim// F. If 7i D {F) > then, from Corollary 



KM H D {F\Tl) = H D (F) > 0. Hence, F\Tg ^ 0, therefore there is x G F which 



is semi F/iV-random. Thus, we see that dim^F = dim//F. Moreover, if dim//F is 



a computable real number, then using Theorem [A.3| in a similar manner we see that 



dim^i F = dim j 42 F = dim H F. □ 

Theorem A. 9. Let Si, ... , S m be contractions on M N . Suppose that each Si is an affine 
transformation, i.e., for each i, Si(x) = MiX + t>j where Mj is an N x N matrix and is 
a vector in R . // a// matrix elements of Mj and a// components of Vi are computable real 
numbers for each i, then the r.e. condition holds for the invariant set of S\, . . . , S m . 



N 

> 



Proof. Let F be the invariant set of Si, ... , S m . Since Si, ... , S m are contractions on 
there exists I G N such that Sj(F) C F for each i where E = { x G R N | \x\ < 1/2 }. We 



write Si lt _ t i k = Sjj o • • ■ o Sj fc . Using Theorem [L2| , for each k it is shown that 



Fc U 



Si, (115) 



»fc 



and F fl Sj lr .. ) j fc (F) 7^ for any z'i, ... , z"&. Let ci, . . . , c m be the ratios of Si, . . . , S m 
respectively. We choose r G Q such that q < r < 1 for all z and choose xq G F fl such 
as (0, 0, ... , 0). Then |Sj lv .. ) j fc (F)| < Zr fc for any and z'i, . . . , i k . Since all matrix elements 
of Mj and all components of v j are computable real numbers for all z, it follows that given 
k, z'i, . . . , z'fc, and n G N one can find an /(n; k;ii, . . . ,i k ) G Q w with the property that 

|/(n;fc;ii, ■■■>**) - S il) ... )ifc (x Q )| < -. (116) 

n 

It is then shown that Wl(F) C L C SPT(F) holds for the set L accepted by the following 
procedure, and hence F satisfies the r.e. condition. 

Given (si, . . . , sn) G X N , one checks whether or not |si| = • • • = \sn\ holds true. If 
this does not hold true, then one does not accept (si, . . . , sjv). Otherwise when this does 
hold true, one chooses k such that Zr fc < 5/4 and chooses n such that 1/n < 5/4, where 
5 = 2-l Sl L Let 

A 7 (z'i, . . . , i k ) 

V . 7 (117) 
= [/ J (n; k;tx, . . . ,i k ) -5/2, f 3 {n; k; i lt . . . , i k ) +5/2} 
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where P(n\ k; ii, . . . , i k ) is the jth component of f(n; k;ii, . . . , it,), and let 



A{h, ...,i k )= A\h, . . . , i k ) x • • • x A N {h, ...,i k ). (118) 
It is easy to see that 

Fc |J A{i u ...,i k ) (119) 

and F fl . . . , i k ) ^ (ft for any zi, . . . , i k . One then accepts (si, . . . , sjy) if and only if 

one can find a (ii, . . . , i k ) such that I(si, . . . , s^) fl (A(z 1; . . . , i k ) mod 1) ^ (p. □ 

We refer to the following familiar theorem on a self-similar set (e.g., Theorem 9.3 in 

E3)- 



Theorem A. 10. Suppose that the open set condition (|70|) /io/ds /or similarities Si,..., S m 
on M. N with ratios c\, . . . , c m respectively. If F is the invariant set of Si, ... , S m , then 
dinifl- F = dim^F = D and < H D (F) < oo, where D is given by 

rn 

E c * D = 1 - ( 12 °) 

i=l 

The proof of Theorem |4.3| is as follows. 



Proof of Theorem f£7^. Suppose that the open set condition holds for similarities Si, . . . ,S m 
on M N with ratios ci, . . . , c m respectively. Let F be the invariant set of Si, . . . ,S m . From 
Theorem |A.10| , it is shown that dim#F = dim^F = D and < H D (F) < oo, where 
D satisfies (|71|). Furthermore, suppose that for each i there exist N x N matrix Mj and 
Vi G 7H N such that all matrix elements of Mj and all components of Vi are computable 
real numbers and Si(x) = Mix + V{. Using Theorem |A.9| , we see that F satisfies the r.e. 



condition. Since each q is a computable real number, D satisfying ([71]) is also a computable 
real number. It follows from Theorem |A.8| that dim^i F exists and dim^i F = dimj^ F. □ 

Corollary A. 11. Let P = {pi,P2, ■ ■ ■ ,p m } be a finite prefix-free subset of X, and let F be 

the set of infinite binary sequences that consist of elements of P , i.e., 



Then 



where D is given by 



F = { qi q 2 q 3 ...eX co \q i eP for each i } . (121) 



V a G F VtieN H{a n ) <Dn + o(n), (122) 
3 a G F lim H(a n ) - Dn = oo, (123) 



^2- fl|ftl = l. (124) 
i=i 
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Proof. For each i, let S{ be the similarity on R with Sj(x) = 2 ' Pi 'x + O.pj. Since P is a 
prefix-free set, it is shown that Si, ... , S m satisfy the open set condition. Note that all 
of 2~l p 'l and -Pi are computable real numbers. Let R(F) = { O.a | a6f}. Then R(F) 
is the invariant set of Si, ... , S m . From Theorem fO| , we see that dim^i R(F) = D, and 
hence the results are produced. □ 

Proposition A. 12. Let D be a real number with < D < N. 

(a) dim^Tg = D. 

(b) If D is a computable real number then dim^T^ = dim^Tg = D. 

Proof. Since the results are trivial for D = 0, we assume that D > 0. 

(a) For any e > 0, we choose a computable real number d such that D — e < d < D. 
Noting Theorem [4.3| , we can construct similarities Si, ... , S m on 1R such that dim^ F = 
dimff F = d holds for the invariant set F of Si, ... , S m . Hence, F C Tp and therefore 
D — e < dim^Tg. Thus, D < dim^T|, and using Corollary |A.4| the result is produced. 



(b) From the fact that I^C^cT^, it follows that D < dim^ T|, < dim^T^. Since 
D is a computable real number, using Theorem we see that dim^T^, < Thus, the 



result is produced. □ 
Note that Proposition |A.12| (a) was derived by 



Acknowledgment 

The author would like to express his special thanks to Prof. Ichiro Tsuda for a great deal 
of valuable advice. 



References 

[Bn] Barnsley M. F., Fractals Everywhere. Second edition. Academic Press Professional, 
Boston, 1993. 

[Bz] Barzdin' J. M., Complexity of programs to determine whether natural numbers not 
greater than n belong to a recursively enumerable set. Soviet Math. Dokl. 9 (1968), 
1251-1254. 

[CH] Cai J.-Y. and Hartmanis J., On Hausdorff and topological dimensions of the Kol- 
mogorov complexity of the real line. J. Comput. System Sci. 49 (1994), 605-619. 

[CI] Chaitin G. J., A theory of program size formally identical to information theory. 
J. Assoc. Comput. Mach. 22 (1975), 329-340. 

[C2] Chaitin G. J., Incompleteness theorems for random reals. Adv. in Appl. Math. 8 
(1987), 119-146. 



28 



[C3] Chaitin G. J., Algorithmic Information Theory. Cambridge University Press, Cam- 
bridge, 1987. 

[Fl] Falconer K. J., The Geometry of Fractal Sets. Cambridge University Press, Cam- 
bridge, 1985. 

[F2] Falconer K. J., Fractal Geometry — Mathematical Foundations and Applications. 
John Wiley & Sons, Chichester, 1990. 

[Ha] Hata M., On the structure of self-similar sets. Japan J. Appl. Math. 2 (1985), 
381-414. 

[Hu] Hutchinson J. E., Fractals and self- similarity. Indiana Univ. Math. J. 30 (1981), 
713-747. 

[K] Kolmogorov A. N., Three approaches to the quantitative definition of information. 
Problems Inform. Transmission 1 (1) (1965), 1-7. 

[LV] Li M. and Vitanyi P. M. B., Kolmogorov complexity and its applications. Handbook 
of Theoretical Computer Science (J. van Leeuwen, ed.), Vol. A, Elsevier, Amsterdam, 
1990, pp. 187-254. 

[M] Martin-L6f P., The definition of random sequences. Inform, and Control 9 (1966), 
602-619. 

[Rl] Ryabko B. Ya., Coding of combinatorial sources and Hausdorff dimension. Soviet 
Math. Dokl. 30 (1984), 219-222. 

[R2] Ryabko B. Ya., Noiseless coding of combinatorial sources, Hausdorff dimension, and 
Kolmogorov complexity. Problems Inform. Transmission 22 (3) (1986), 170-179. 

[SK] Saito A. and Kaneko K., Geometry of undecidable systems. Prog. Theor. Phys. 99 
(1998), 885-890. 

[STI] Sato Y., Taiji M. and Ikegami T., Self-similar sets as satisfiable Boolean expressions. 
Unconventional Models of Computation (C. S. Calude, J. Casti and M. J. Dinneen, 
eds.), Springer- Verlag, Singapore, 1998, pp. 352-370. 

[So] Solomonoff R. J., A formal theory of inductive inference. Part I and Part II. In- 
form, and Control 7 (1964), 1-22; 7 (1964), 224-254. 

[Stl] StaigerL., Kolmogorov complexity and Hausdorff dimension. Inform, and Comput. 
103 (1993), 159-194. 

[St2] Staiger L., A tight upper bound on Kolmogorov complexity and uniformly optimal 
prediction. Theory Comput. Systems 31 (1998), 215-229. 

[T] Turing A. M., On computable numbers with an application to Entscheidungsproblem. 
Proc. London Math. Soc. 42 (1936), 230-265; Correction, Ibid 43 (1937), 544-546. 



29 



